This is my small project for testing raw video from embedded mobile camera as a background in simple arcade games for cheap VR Glasses.
VR Glasses have a door that may be opened during the game. Imho: real picture as a background minimize motion sickness and add some "homemade" effect for gaming.
I have made a small arcade with Unity , Google VR SDK, Wireless joystick "VR CASE" .